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The invention relates to a data processing system with clustered ILP processor 
as well as a clustered Instruction Level Parallelism processor. 

One main problem in the area of Instruction Level Parallelism (ILP) 
processors is the scalability of register file resources. In the past, ILP architectures have been 

5 designed around centralised resources to cover for the need of a large number of registers for 
keeping the results of all parallel operation currently being executed. The usage of a 
centralised register file eases data sharmg between fimctional units and simplifies register 
allocation and scheduling. However, the scalability of such a single centralised register file is 
limited, since huge monolithic register files with a large number of ports are hard to build and 

10 limit the cycle time of the processor. In particular, adding fimctional units will lengthen the 
interconnections and exponentially increase the area and the delay of the register file due to 
extra register file ports. The scalability of this approach is therefore limited. 

Recent developments in the areas of VLSI technologies and computer 
architectures suggest that a decentralised organisation might be preferable in certain areas. It 

15 is predicted that the performance of fiiture processors will be limited by communication 
restrains rather than computation restrains. One solution to this problem is to portion 
resources and to physically distribute tibese resources over the processor to avoid long wires, 
having a negative effect on communication speed as well as on the latency. This can be 
achieved by clustering. Many modem microprocessors exploit Instruction Level Parallelism 

20 (ILP) in form of the Very Large Instruction Word (VLIW) concept. The clustered VLIW 
concept was realised in many commercial processors, like HP/STM Lx, TI TMS320C6xxx, 
Sim MAJC, Equator MAP-CA, BOPS ManArray etc. In a clustered processor resources, like 
fimctional units and register files are distributed over separate clusters. In particular for 
clustered ILP architectures each cluster comprises a set of fimctional units and a local register 

25 file. The clusters operate in lock step under one program counter. The main idea behind 
clustered processors is to allocate those parts of computation, which interact firequentiy, on 
the same cluster, whereas those parts which merely communicate rarely or those 
communication is not critical are spread over different clusters. However, the problem is 
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how to handle Inter-Cluster-Commimication (ICC) on the hardware level (wires and logic) as 
well as on the software level (allocating variables to registers and scheduling). 

A known VLIW architecture has a full point-to-point connectivity topology, 
i.e. each two clusters have a dedicated wiring allowing the exchange of data. On the one 
5 hand, the point-to-point ICC with a full connectivity simplifies the instruction scheduling, but 
on the other hand the scalability is limited due to the amount of wiring needed: N(N-1), with 
N being the number of clusters. Accordingly, the quadratic growth of the wiring limits the 
scalability to 2 - 10 clusters. Such an architecture may include four clusters, namely clusters 
A, B, C and D, which are fully connected to each other. Accordingly, there is always a 

10 dedicated direct connection present between any two clusters. The latency of an inter-cluster 
transfer of data is always the same for every inter-cluster connection independent of the 
actual distance between the clusters on the chip. The actual distance on the chip between the 
clusters A and C, and clusters B and D is considered to be longer than the distance between 
the clusters A and D, A and B, B and C, as well as C and D. Furthermore, pipeline registers 

1 5 may be arranged between each two clusters. 

In the above VLIW architecture wire delay problems of the control signals are 
still present. The control signals are used in order to distribute operation information to the 
functional units and the register files of the respective clusters. Here, the VLIW mstruction is 
executed in the same cycle. Therefore, all control signals to the respective clusters have to 

20 reach these clusters within the same cycle. This imposes a problem for the case that some of 
these clusters may be arranged on the floor plan of the VLIW processor further apart from an 
instruction fetch/dispatch unit issuing the control signals to all clusters. In the above case, 
where clusters D and C are fartfier away from the clusters A and B as well as from ihc 
instruction unit, the processor's cycle time will depend on the time period, required for the 

25 control signals from the instruction fetch/dispatch unit to reach the most distant cluster. 

Another ICC scheme is the global bus connectivity. The clusters are fiilly 
connected to each other via a bus, while requiring much less hardware resources compared to 
the described above ICC with a fiill point-to-point connectivity topology. The bus 
connectivity allows for easy implementation of multicast. The scheme is furthermore based 

30 on statical scheduling; hence neitiher an arbiter nor any control signals for the bus are 

necessary. ICC bandwidth can be readily increased by adding buses. Moreover, the latency of 
the ICC will increase due to the propagation delay of the bus. The latency will further 
increase with increasmg numbers of clusters limiting the scalability of the processor with 
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such an ICC scheme. Consequently, the clock frequency may be limited by connecting 
distant clusters like clusters A and D via a central global bus. 

It is therefore an object of the invention to improve the latency problems of 
instruction and control signals in an ICC scheme for a clustered ILP processor. 
5 This object is solved by a data processing system according to claim 1 and a 

clustered Instruction Level Parallelism processor according to claim 5. 

The invention is based on the idea to specify operations from diflferent cycles 
in one VLIW instruction and, consequently, to pipeline control connections to remote 
clusters. 

10 Therefore, a data processing system is provided. Said system comprises a 

clustered DLP processor having a plurality of clusters each comprising at least one register file 
and at least one functional unit, as well as an mstruction xmit for issuing control signals to the 
clusters of said processor. The instruction imit is connected to each of said clusters via 
respective control connections. Furthermore, one or more pipeline register(s) can be arranged 

IS m said control connections according to the distance between said instruction unit and the 
clusters. 

According to this instruction set architecture higher clock frequencies can be 
achieved, since the clock period is not limited by the longest delay in control signals due to 
the longest distance between the instruction unit and the most remote cluster. In other words, 
20 longer delays in the control wires to distant clusters can be adopted. 

According to a further aspect of the invention the clusters are connected to 
each other via a point-to-point connection. By this point-to-point inter cluster commimication 
scheme the instruction scheduling is simplified. 

In still a further aspect of the invention said clusters are connected to each 
25 otiier via a bus connection. Such an ICC scheme is advantageous, since less hardware 
resources are required. 

In another aspect of the invention the control connections are implemented as 

a bus. 

The mvention is also related to a clustered ILP processor comprismg a 
30 plurality of clusters each having at least one register filed and one functional unit, as well as 
an instruction unit for issuing control signals to said clusters. Said instruction unit is 
connected to each of said clusters via respective control connections. One or more additional 
pipeline register can be arranged in said control cotmections depending on the distance 
between said instruction unit and said cluster. 
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The invention will now be described in more detail with reference to the 
drawing, in which: 

5 Fig. 1 shows a clustered VLIW architecture according to a first embodiment; 

Fig. 2 shows a bus based clustered VLIW architecture accordmg to a second 

embodiment; 

Fig. 3 shows a point-to-point clustered VLIW architecture according to a third 

embodiment; 

10 Fig. 4 shows a bus based clustered VLIW architecture according to a fourth 

embodiment; 

Fig. 5 shows a pipeline flow chart according to the prior art; and 
Fig. 6 shows a pipeline flow chart according to the invention. 



15 

Throughout the figures, dashed lines designate control wires, whereas solid 
lines designate data signal connection. 

In Fig. 1 a clustered VLIW architecture with a full point-to-point connectivity 
topology according to a first embodiment is shown. Hie architecture includes four clusters, 
20 namely clusters A, B, C and D, which are fully connected to each other and an instruction 
fetch/dispatch unit IFD being connected to each cluster A-D via control connections paths 
CA-CD. Accordingly, there is always a dedicated direct data signal connection present 
between any two clusters with pipeline registers P arranged between each two clusters. The 
latency of an inter-cluster transfer of data is always the same for every inter-cluster 
25 connection independent of the actual distance between the clusters on the chip. The actual 
distance on the chip between the clusters A and C, and clusters B and D is considered to be 
longer than the distance between the clusters A and D, A and B, B and C, as well as C and D. 
Therefore, a pipeline register P is arranged in the control connection paths CC and CD, in 
order to pipeline the control signals to remote clusters C, D. 
30 The instructions for a prior art smgle cluster VLIW processor having two issue 

slots can be implemented as follows: 

opl rl, r2-^r3 nop; 
nop op2r3, rlO-^11; 
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Hie same operation in a two cluster VLIW processor is implemented as 

follows: 

opl rl, r2->r3 nop; 

copy r3 -7>r3 [B] nop; // copy rS from cluster A to r3 in cluster B 

5 nop op2r3, rlO-^11; 

The same code is implemented according to the first embodiment, i.e. cluster 
D being remote and therefore requires one extra cycle for operation delivering, as follows: 
opl rl, r2-^r3 nop; 
copyr3-»r3[D] op2 r3, rlO^ll; 
10 Please note, that tiiis scheduling is valid although op2 is placed in the next 

VLIW instruction, due to the feet, that op2 will only be executed in cycle 3. Accordingly, 
operations from different cycles are summarized m one VLIW mstruction. The following 



table 1 shows some instructions for cluster A and cluster D, wherem the cluster D is distant 
from cluster A. 



Cluster A 


Cluster D 




opl rl, r2->r3 (*cycle 1*) 


op3 (*cycle 2*) 


(* instruction 1*) 


op2 r3->r4; (*cycle 2*) 


op5 r3->r4 (*cycle 3*) 

• 


(♦instruction 2*) 


op4 rl, r4->r5 (*cycle 3*) 


nop (*cycle 4*) 


(♦instruction 3*) 



15 

Accordingly, instruction 1 comprises opl and op3, which are executed in 



cylces 1 and 2, respectively. Instruction 2 comprises op2 and op4, which are executed m 
cylces 2 and 3, respectively. Instruction 3 comprises op4 and nop, which are executed in 
cylces 3 and 4, respectively. The execution of operations in the remote cluster D is one cycle 
20 behind the operations in the proximate cluster A, i.e. operations executed in the same cycle is 
a somewhat slanted VLIW instruction. 

This instruction set architecture ISA is implemented by pipelming the control 
connections to the remote clusters D and C. Such an ISA is in particular advantageous for 
clustered ELP processors, with more than three clusters. 
25 By the implementation of the above ISA the cycle count may be increased 

because of the extra latency of the control distribution to distant clusters. Furthermore, a 
slight modification in the instruction schedule being part of a compiler, may be required 
properly handle the operations in the VLIW instructions accordmg to Fig. 1. Usually, tiie ICC 
is implemented by inter-cluster copy operations. An instruction scheduler of the compiler 
30 determines whether a copy between two operations can be scheduled. Preferably, the 
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compiler for a processor with pipelined control distribution should consider the cycles, in 
which a consumer operation is executed raflier than the VLIW instruction. 

Another ICC scheme according to a second embodiment is the global bus 
connectivity as shown in Fig. 2. The clusters A, B, C, D are fiilly connected to each other via 
a bus 100, while requiring less hardware resources compared to the ICC scheme as shown in 
Fig. 1. The scheme fiirther comprises an instruction fetch/dispatch imit IFD, which is 
connected to all clusters A-D via a control interconnect 110. A pipeline register P is arranged 
in the control interconnect 1 10 between the clusters B and C, wherein the clusters C and D 
are for any from the clusters A and B, This pipeline register P may require multiple instances 
in the actual implementation of multiple control signals of a real processor. Accordingly, as 
in the first embodiment the ISA is implemented by pipelining the control mterconnect 1 10 to 
remote clusters. 

Fig. 3 shows a point-to-point clustered VLIW architecture according to a third 
embodiment. This architecture is quite sunilar to the architecture of a clustered VLIW 
architecture according to Fig. 1. It includes four synchronoiisly run clusters A, B, C and D, 
which are fiiUy connected to each other via a direct point-to-point connection. Accordingly, 
there is always a dedicated direct connection present between any two clusters, so that a 
dead-lock free ICC is provided. 

Furthermore, this architecture comprises an instruction fetch/dispatch unit 
IFD, which is connected to each cluster A-D via control connection paths CA-CD, 
respectively. The actual distance on the chip between the clusters A and C, and clusters B and 
D is considered to be longer than the distance between the clusters A and D, A and B, B and 
C, as well as C and D. One pipeline register P is arranged between the clusters A and B; B 
and C; C and D and; D and A, while two pipeline registers P are arranged between the remote 
clusters A and C as well between the remote clusters B and D. Accordingly, the number of 
pipeline registers P between clusters can be proportional to or dependent on the distance 
between the respective clusters. Moreover, one or more pipeluie register P are arranged in the 
control path CC and CD. Alternatively one or more pipeline registers P are arranged in each 
of the control paths CC and CD, in order to pipeline the control signals to remote clusters C, 
D. 

This architecture is a clustered VLIW architecture with a fully connected non- 
uniform latency inter-cluster network. In particular, the latency of the ICC connections is not 
uniform, since it depends on the actual distance between the respective clusters on the final 
layout of the chip. Regarding this aspect the architecture of the present invention differs from 
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the architecture of the clustered VLIW architecture according to Fig. 1. This has the 
advantage, that wire delay problems are reduced by deeper pipelinmg inter-cluster 
connections between remote clusters. The advantages of the VLIW architecture according to 
the third embodiment over the clustered VLIW architecture according to a first embodiment 
5 is that by providing the non-uniform latency the wke delay problems are improved. But on 
the other hand, the scheduling becomes more complex than for clustered VLIW architecture, 
since the compiler has to schedule the ICC in a network with a non-uniform latency. 
However, the ISA is implemented as described in the first embodiment with regards to table 
1. 

10 Fig. 4 shows a bus based clustered VLIW architecture according to a fourth 

embodiment of the invention. The architecture of the fourth embodiment is sunilar to those of 
the bus-based clustered VLIW architecture according to Fig. 2, Distant clusters, like cluster A 
and D, are connected to each other via a central or global bus 100. However, this will lead to 
a limitation of the clock frequency. This disadvantage can be overcome by providing a VLIW 

1 5 architecture as described above according to the first embodiment. In particular, the bus 100 
is pipelined, the latencies of inter-cluster communication is made non-uniform and dependent 
on the distance between the clusters. E.g. if cluster A sends data to cluster B, this will require 
one cycle, while a data move between cluster A and the remote cluster D require two cycles 
since the data has to pass the additional pipeline register P arranged between the clusters B 

20 and D. 

Furthermore, an instruction fetch/dispatch unit IFD is provided, which is 
connected to each clusters A-D via a control interconnection 1 10. In particular, a pipeline 
register P is arranged between clusters B and C, i.e. between the proximate clusters A, B and 
the distant clusters C, D. However, flie instruction scheduling of this bus based clustered 
25 VLIW architecture corresponds to the schedulmg of the point-to-point based clustered VLIW 
architecture according to the first embodiment. 

Fig. 5 shows a known pipeline flow chart, which is identical for all clusters. In 
step SI an instruction fetch operation and in step S2 an instruction decode operation is 
performed. A register is read in step S3 and a respective operation is executed in step S4. 
30 Finally, a write-back is performed in step S5. 

Fig. 6 shows a pipeline flow chart according to principles of tiie mvention. The 
mvention is based on the idea of a pipeline architecture that is different for proximate and 
remote clusters. Therefore, for the clusters close to the mstruction fetch/dispatch unit IFD, the 
pipeline - implemented by steps SI -S5 on the left hand side of Fig. 6- is identical to the 
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pipeline according to the prior art, i.e. shown in Fig. 5. However, the pipeline for a remote 
cluster (on the right hand side of Fig. 6) incorporates an additional pipelme stage for 
transferring the control signals from IFD to the cluster, i.e. step S2a. Note that the pipelme 
front-end, including instruction fetch and decode stages steps SI and S2, is nevertheless 
shared for proximate and remote clusters. Furthermore, each pipeline stage shown on the 
figures may contain several sub stages without changing the idea of different pipelines for 
close and remote clusters. 

Please note, the principles of the present invention may be applied to VLIW 
and EPIC (Explicitly Parallel Instruction Set Computing) processors but not to super-scalar 
processors, which have a diflEer^nt instruction set architecture. 



